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(57) Abstract 

PURPOSE: To allow the user to react the content of an 
Image in real time to make the operation by displaying a 
video image by a video signal and an image ge nerated by 
a computer overlapping ly. 

CONSTITUTION: A video camera 1 inputs the position 
data of a specific object (finger tip of user) to a 
computer 2. The computer based on the position data 
calculates the overlapped position of a screen 3. 
calculates it address and transfers data of an image 7 
to be superimposed on the address to a screen buffer in 
a video capture board 10. The video image of the camera 
1 and the image 7 of the computer are displayed 
superimposingly on the screen 3 b ased on the data in the 
board 10. 
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1 

r, 

tetanias <tfg=» > b ^ - * <t offiiamigim^i&v& 

{lit. 

[If** 2 ] H#m l fcBI^IMtetfJ^f-Atc*^ 

T . 20 

gs l mts? i, b * y 7 x * *> c t 1 1 zm®. 

ifE^-^Affi^SKJ^ffi^Sft^&gWSK.i: 
0. ±fE3>b:*-*©lWC£j&ir£ISf!^gt7*{4H 

*»aer -s c t 1 1 zm»-&i£i'Z r a„ 

30 

JiSEx- * AW**«K J: 0 tiWSftS&gfSSSKJ: 
[IS^a® 5 ] 1 . 2 . 3SfcB4 K!SiS<DiIif§^ 

jKi^f-AtcfcUT. 

Ut*#^~>XfA©eiH^t?$>or. 40 

k tr x * * y 5 \m & zme o x * £j&-f s f6 

&SlHJ^©M:a'©1#?R£t£tHU 3&tfcffiOfctt#R£. 
Rtft * y ^ #1* "5 &A,tdm& J £ : %Po>ffi%l± 

Ub#fgSxX^AtCtet>T. 

!^{|!^#*>e>^©^(*©A*;**St> 
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2 

Igb^* * y 5 i&ra > b ^ - £ -©F^Kl^ai LTcm 

&n>t^-*-tt. ^x-SiiiBb-r^y 5# 
W^mUbTISiD^/c^l ©|ft«7 : -*©ffeK > ± 
ffi=i > f ^ - * #£l£-r S IS 2 omfc?- Z h 
±5E&fflUfc1tfB©S2!K:J:<5§<f L 
/ctS^lED-C. Rfjll©B^£&|ff2©BjWfc£±sS:3 
> b a - $ -©gUSOSS±fcSfcTg|^-rS C <fc 

CSS*3S8 ] if3tS7iC§eSS©7 i Uf^§|->^7 i AKte 

«t O fcJLi BtiMB t ±f ESS 2 ©B*&©l!8& <fc <3. JJB a 

[ff33I9 ] ff^SCclESgc^ub^fg-VJX^AW:*} 
or. 

Jg-©t*{g<r- £ t"A ©ttff *iWffli-r 
^frTn-ria^-c&t). ±ie^©^S¥<**5±iEa^iaB 

±<D&m&<D^ftxm%<DWtt'< = its: *> C t CC J: O^X 
Y ZZt tmWlt ?*>7-V b'^g-> X r 

A. 

[0 0 0 1 ] 

xfAi i^xmrn?*. 

[0002] 

[ef*©^{if5] *iS. ff«>7^tftf^«;i' 

(Diati-r z> mw&Z'* v 3 >^© =3 > t- a - $ (cax o 
-e©^i";->K:^-r€.£«^®sgtctT^ton-5 

<k'?lctj:-?XZtc. C©e«j©/cit>K:«. 3>f*-$ 

b-r^-ft-^^ z maimer- $ K&m lx =j 
>tr»-fy*y-{cffiDiitj fc2&©tit6g:si^- K =& 
n>b-3.-*©ffi3Bxa? h tcffi^W 5. c 
©^- Ftc±IEb^{i#?rA^-r-5>C<tK:J:D. =i> 
tr ^ - ^ © * * - >©— s 1 4J±gp«: *m*% 
t n -s v r )v * -< a cc 7, w - > K.s&jk s n 

So 

[0003 ] 3 ±SE#- !~<D<PlC\ttm<DVy h 
K «fc 9 . «5yBffi©*a» 4t> »— «J©g««*#±iB 

#-r * «tl £ il JO L /c *>©*>£>£ „ 
[00 04] W±©J:^K:Lr^*)-5>t<^otlKDiZ^/(: 

[000 5 ] 
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3 

fi£-,-c3>t-*-* mizmmT- *±&K.t>tc -> x-m 

©iltg^KTSSfe©©. COWfe?-* Of-Z&M 
tSBUSMIHw > f * - * -ic t r, XteWrkU i><DV3b 

^•SCD-C. *<DW&<Dp¥&K.m^-C VrtoZ-i AKK 10 
Ic-U SWT £C<hSiE&-e2> 
[000 6] ±S2ffi8K:&*. e©S?fc^8 

£®«rs*>©-e£>&. 

[0007] 

[g6S£JS&-rS;fc«>©#-&] RflMt-^et&frr&ttft 
E©— SP*St,^i^gi5«:^T-S=i> t a - Hipf^t£i> 

£ ©IB fc«»ffi U £ 

«-r67 r -f Aa**a*»*. &3>t*-*tt. se 
ffisftfciwwcisc-c. ±iaw»{t-^ffi^#e:J:oixf3 

i^feJiS2!SWft{t#«:«l:i!Bfc«i. ±f23>t.*-**i 
[0008] t/c. eft*>7i3>fa-*-*ffl 30 

ma&m^fr h ^©«3?#©a » s * 4 1 > k&k* •*> 
©M^e^-r^^-f Ata^a^m, g[3>b-a 

l/tKOMfc'Il ©^^-^©ffetc. ±123 >t* 

-^j^/aT*^©®®^-*^^*^^:* 40 

KJ|ll©!W*4«ffll2©!*«*±E*H5l/fcf»« 
©ejHtCfcOS^tLfctSaKlED-C. ±123 

4. 

[0009] 

[flUf] ffijg©!WR©^*S*-St»B-€-©ttg*St>« 
*©W2T©f1l*«ftau fcfCttftUiSti 

«%3>lia-*-lCA*T5CiKJ:!). 2>fa- 50 
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frttgumtcS-^T. •;r;i'*^ AtcsiSLr. ±12 
isMRffi^ffi^S.fcOKOj^/clBMfei. ±i23>tr» 
- $ *«£j«T ■SHIR* 4 V » tt±f 2 3>f^-£ #±f28fe 

«flr-9ffl**a i «so©?*«^is* 0 &ugftft 
s^-rsc tan-ess. 

[0 0 1 0 ] &1£$gtCKJ£0T. yT^-fAKSwt 
[001 1 ] ^©WWfcDflUHCJfcCT. 3 

jsj^bet -6iffi«©«^flai«ay£r set* 
mm. 3 > e * - * w&$fr2>w&<o&m&& 

[0012] 3 <=>{C. 1t^©M^{*©feg(Cj£D-C. 3 

*»<MB**^liW4Ci-C. J:<35ft»^©W4^U-b* 
>-?--5xa>ffl©iffi«*fPfirr*C4fc-CtS. §6K 

fitT S31*©#3£«5f flap** £ 3 > - Z ifi^t 

[0013] ttc, ^©fc&^se s fet^stn 
-cfr<-grrs©-c. tftretfsacctt&. 

[0014] flfflflWBftiW-Ctt < . ^SS^(*©A# 3 
[0015] C©'>Xf-A«r-rU t#Sli/X r"A tct&ffi 

MO-Cffl^A-Str^i^PI^CCGSirS^-fAa^ 

LfclffBCCVT^^-l'AtcjED-C. ±l23>fa-5r- 

©a^nrasi^sJar^-r^ct^-rits. c©->x 

xA?:ffl(,»n«. ffiS©14B«:SS«:|Sg»-j--SB«i«p 
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*W»K«JBU i-1f#*ft*mO&#&BWir*JB 
[0016] a«i«#HK:^ilttlW¥#*> 

«:Ebu £%h<Dmfrh$>T t'txuimti,. cum 

*-*»MWc»ft L^T < . #>o*B^k: S0<Dfftt«s 
Sift? 5 ft. JrOBJBW-cn»tt«B*»tt9Ci*«r* 

[0017] 10 
[HMffll] ■ 1 1 co^CT^^-To l \m 

tf-~, 5 !f-CDJ8jfc, 6i^>k^-^-^^'j 

— x ^ y — >^^®ni 3 gc«5* $ h/c3> t* 3. — &—<d 

[0018] tr^^y^ 1 tta-lf 4**Ott«*» 
RL/, 8 *BSl/r a >hT»--* 

h\ i i^>yr;w>^-7x-^ 12« 

H2«^>^-7x-X 1 1 3«CPU (Central Pr 
ocessinq Unit) , 1 4 A-^r- ^^rffitST 

^y^'jr^^RAM, 15tt^ 16(mx, 1 
7tt*-«K-F"C** Q J.-1f-4^n>f A -^-2 30 
ii&ft'rZtc£><D'WX 1 6£*-#-Fl 7«=»>t* 
*-*-F«i<DHia*S«-<>*-7*-X 1 2(c£tt3ft 

^-7x-xi i , ®jaag^>^-7x-^ i 2, r 

AMUtt, 3>t , a -^-rt0;^15K:ctO l CP 
U13iS^nT*5 0 t CPU 1 3 tC«fcDSO®$tl 

-r^-fi-^r^O , cft%n>b*;*-£-KlX9iMffc2& 
CCBtr^***^^-*- F£>9Kti&XKftK*S!& 
fifctt*. Kfirtt, gStff^t^t-^-F 40 

tr*-^-ttitH^n * FOCtff*** + F 

+ F l OrtcDx^y-VM^^r-tctSSftS 
n& 0 c<dx* y - > a ? 7 7 - iai*a*B»Ki/*i 

-^^JB^R^au-c. n>b'.*-£~CDx#y->3 

tctMMratoirft. 

[0019] *»!BTtt, 8WR<l#^6SC//cU/c#S 50 
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6 

sr. t»«**flir**tt«:ociTas^4. tr^* 
-**fi#«9*a*Lr3>fc:*-*-2{cear 

ho fi#*9», tT7 r ^^7li3>t , a-$-2^ 

>t A -*-2#b-r:*;*M7 l©SMB©fctf>fc, 

Ui-ecD3v> FtcjSDfc«rf^*?fl^ 3^>FtCcfco 
rtt, tt«**w*^:*3<Dlim*3>tra-*-2«: 

fB»jew¥»ot4m»«*Bwr * ^> f -c* o , ± 
[0020] H2trtt, «-*Ki9tt^y3>rt©^i;T 

[0021] oar«: % im.tmft<Dmnic&cx, 

££:3>b" A-^-2tCA^r^, 3>b # ^-#-2 tt: 

g^cMta^t>i±^-<#iii^70f r -^^, h'-r^^-^ ^ 
^ H l 0rt(D^^y->^*^7r-K:KiSr 

ho C©tr9 r *+ + ^'**-5K- FrtOf*-***:*^,* 

r, ic7)^<h3>fA-^-cDiS^7^^^ y 
t^t-#-F4ffimt 4 ^n^wm/cit 

^gilK ^-(Df=-^frcj:0=i>b^-^-2«S7 
[0 0 2 2 ] H«7<D— Sl^SWc 
3tfcoc>TB£ ft £-<z> c £ *JHRSlffiJtcieH-C # £ c £ £ 

«s»*w*fccatK «iKffiawttH«*4fifcr&c' 
[0023] 9*. tr^^^^ l^e>Ist t 9 5A^/cBft^ 



C5) 

7 

c ©iffiSW: tf^* > 7 l i*g©?fc&#i3IK: J: 9 5 c 
T S<t^tC-rscifeoJSgT?*-5. £'%e>©t§^fc. M 

^^y^KttccDaiEtJfiiasnrcittt*^ tut io 

c©««3&«i*rtisn-c(r>4t©fc*5. 

[0024] ±E{C3as^fctW¥tc-3(,»r. «t» u < a 

[ 0 0 2 5 ] S3(C±gBg^^-rSt:7 t **y 5 1 
(D-fV. v W&fjklr „ 201JCCD (Charge cou 

pled device) fe>tJ--, 2 1 5{g^fflillHl«&> 

2 2«fcr7 r ^{i^ffl^^. 2 3tt®{SffltBllSS. 2 4 
ttAttfc*J*?\ 2 5«2 1 -2 5^©-^>^-7 
fi^r**. »ffi*9#©IMlS*JCCD-fe>-!»--2 0«: 20 

.fcD&msft. ->r>, -f iq — , 

©es^©^K#j£r4««fi#«:s*s*is. *^ 
*flr«MSffli3B2 i ttc©iife(g#*M^MSL/-rji^ 

©tr^-ff-^ (NTSC7tnm*fl^ft£) *IH 
*«ff2 2«fci3fcH^-rS„ *^5<t#«HffilalK2 lfctf* 

0 . /J^-cffiffits© * y 5 m#*a&lHlS8# 7 s ^ * >m 
BSr«fi8"C#4J:9«:ttofc. *7^<I#«i3@882 1 

rtrtt^-t froMffis^?-* (Y) fcJci^feM^ 
-* (c) cne.^i®^amiHifS2 3tcin 30 

•2>. SH£!AttII!l$2 3 tt±i3^ -/ ££813111, 

KHr*tt«*Si>tt*SS©1IMI*ftl|tU Atti^lS 
^2 4J:0m*-r^.o AW*flK'2 4B. HlK*tj4 
«jaS9*«:H-i-*flMB*. Affi*>i£^2 4 £>IDT=i 

[ 0 0 2 6 ] m 4 (Ciij®ffitt!laI8§ 23©^n, 2>IE©— 
3 0 ttA#*FJ\' 3 1 \t-B{t®&. 3 2tt 
3 3BCPU, 3 4«Atti;fr3ft^-C$>£. C 

©HKMi. »jei^#ft*©i$jei(PP#©«BBacjffe 40 

A^ffiT-3 0 J;0A^L7c»g*jJ:o-feMfs# 
©f r .<5;£.il'7 r --*£-ffi{tlIlSS3 1 KJ: tUfKRc/fe 

3 2W3|«t«J?(ttiJ«*EtW*fe©r*»). CPU 3 

3«c©y*y-{ciatet,fci 7 1 — a. $>ZMty 4 
-ju Ftt©wjetftVtt«tt&::tfftsR3 1 ©uaitfc 

«l/T. Jg7 U-A©^jetS3f WHM«lfff-rft. C© 50 
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«. {£. x U tT a >^&5fJ?B#Vol . IS , N08 , ppl 

3-18 ra^atHMs^^^j KE«sti-cv»*.- vmm 

CPU3 3iZC<0?-$im^&J&&M#<D*i&2& 

tat. »***t»«*w»©flUitcBr4it««r»ar 

CO 02 7 J Ei5(Clf5£^<*©{3ig<!:A#3©#aia 

-oit. ^8&tt€Hthfeh©j&£tRJtf£*ti>. -e©ft 

©S$iLr^«i)-SCir4>5». .y-t'J-B 2rttcttia 
5 K^T <fc 5 (C . 3 5 -X.it 2 IS 

9 > -*#*6tl«. §*«®*i^^T1#5£*£¥#«iS3 5 
"Cti-r-^ffil . ■£©flfe©®J3jrtt? !: -*ffi0-c*S. 
C P U 3 3 Jt*T*iafl«x 0 ccfcor. 
«3 5 ©**&e«MN©SB{fc«y l . y 2 *tHW 
■5> = c©ftg£^T©*¥&gKfct>T?T&5 cite 
J: 9. SS^ffct?©**!!. */Ml&foe>&c£#-C& 
•5. tWW©*¥ttixl, x 2tc-3t,»-ct>. 

Btf»/^J©g**-C*»). **S#5c^*©fi[Sl* 
(xl+x2)/2, (y l+y2) /2. A#S« 
(x2-x 1) , (y2-y 1 ) r*-5. 

coo28] maimtottB&a** 3©nm». a 

UJOSn-S. m*^7lrtOCPU3 3B^>$- 
^x-^S^jiD-C^ 3>fa-^-2*f>16n53 
v> FKSJ£OftJftfP%ec-r. ±IEa-7> F© 1 -otc 

o, -e©? 5 -* %sxsr-5. 2|c*j6W«:«yr^5f^A 

tt*ig^5n-5©-C > ±ffi^-» ©i!ft«M* L < «B# 

■y U-A(^«T^^.-2><fc^K:-rS©*5J:t»„ S6K:±fB 
««7 * - v » h ©— {f0£^f . ( a ) &imj&©{£g. 

^c*s*ai4fe©-c*»). ( b > izm&ot&mmmom 

Kl£fC7*-7? h*»5?-TS. fig. A*5©x- 
^«*^^©CCD-fe>^-©iBSg*#{4i-r-2>. §f 
-*tt. CCD©*H3Rtt«t»B"C**J:5. 

[0 02 9] i7Ktf* + t^ft-#- F 1 0©^" 

p -7 i^ia©— 4o«t7 s *(i#A7js j F-. 4 

lWA^K^flH*. 4 2«tftf3-f. 4 3BR 
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/t-. 4 7ttT*-nyRGB«#. 4 8ttHtfj«B^ 4 
9&2CPU-X* y->;t 7 7T--(>5f-7 ^-^0 

l, 52, 5 3i<t&j>z?*~xfmT<hz> 0 mnx 

*4. c*ifc:«s?Kfi# (Y) ife<t# (c) 

#©2«H#*4*^ lim0»^fe3>f J L-^-(C 10 

brfehr^d-^*^- Fur, RGBSHt:^^ 

[0 03 0 J B7tC^l,fcWB\ 3>t'a-^oy7 
^ffll^07;^7-^fAr*5. Tttto%7^;& 

- 4 4 CC tt ^ > # A {c T * ir * pjffift AH3 ^ - h £ , 

5 o<DMmc£K)T Kux^4?nr, x*y->^ 
^7 7 -44^c^n^ ^^y->/^77-4 

T4 8<fc9ffi;*7<*n£ e ttiOjaBCCiOA*^^** 

#4 i«x^y->±tcsi7nsn5. 7 30 

T r3>hn-^5 0 T F UXIS£<Dl*3SK: <fc 

0 x * »; - > 3 ±<D&m&##m ^n^ c 

[0 0 3 1 ] y^^M^-i/XrA^Cit^ 

a5W»«>HO««-r ft to % =?>t'^-^-tcJ: ^ffiSi 
SS^te, CPU^>^-7x-X49^0t, CPU 
#X ^ y ^ 7 7 4 4 KI«i&*%fftt 5 C £ K<fc D 

[0033] ■•7©^-ar*x*y->3jtoc«7ft-r 
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3A^cD^>r iut^frh <Dm&m^<Dmi2J> t 

crater S ft i'o^S^tf x. tf J: I 
[0034] S8K:X^'J->M77 t-4 4 Kg}® 7 
©^-^^^iiSti^iaSS^T. (a) «**y- 
«y ? y - 4 4 <£M* y rtS^— »C7cWtCft^ 

X^'J->;^7 7 -44^i"J->ii 

me o«±<D^*ygjt*fe%. ef^asfccctt-to— 

ttCPU 1 3^J:-pT^-^^i|gC6 3^^l$n^ 

^tol^CSm^aH^CD^-^OWaB' 6 2 

CPU1 3#T*-fe*nJfi6ttRAMl 4ft©y*y«« 
r*£««B6 4tCKttSftr:fe*K Ch4CPU13 
r-4 4(DiSftJttti«K:7 U-AS 
tc^-jrlBIS-rs. ccD{±g« (b) CCjRTJ^tc. ± 

#>£££#-C#S. Htfl^f^^7fi©f-^^ 

C<D— 3C7cffi«*CPU 1 3<DT*-fe*nJtBtt7 FU* 

7 7^gS7Fl/XZ^St^ P 08 (a) 
T^^IC. CPU 1 3tt7 FUXZKottLT, RAMI 
4ft<Dx-££?to£T&o H»f «^JfnI*l*««A© 
WBCciOSCfbT*^ 3>t*-*-2ttc©SWfc* 
flt(C*DSC<b*i-C#4. CO2-oCDKSJ:0r3>t:*^- 
^-2^7 r -^^firg^SLa-C^^ 0 

[0035] &mmmmi%ih zmmttz 
tc, H«7©ffl«fe*n%Ht?je»««o**i-r*c 

i*s-C*4. Pi^7i1#5t^ft7 0<bcD, iOfiMffltt 
(M^to#Ofc»tC±ia2o<Dfiia©IH{C^7^^ h£ 
»^5J:5tc-rSi<fc^. B9liX^y->^-;77- 
flOJbBBftiR!9t5fe©r*4. 111^7(0^-^7 
2 OSBftCDT F U X 7 3 ti^ffiP^ftffia 7 1 ( X 
s, Ys) cfcW^-fe^F (Xoff.YoffD^rflnSLT* 

^^ccb^r^, cnj:DH8 (b) (om&eimi* 
lesr Fuxz*»a-r4ci^a*4. cpui 

3ttCCDT FUXfc*tL*t\ RAMI 4F^Olli^7 Q-r 
SH«7«, ^^y->^^7r-44tc»*ii*ti. 

> y r>i>mt)#- v <fc 9 7 s -f ^ ^ u ^ f ^ >r 4 6 oc 
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[ 0 0 3 6 ] Xmfcmit£tUi> xrfiyjt^&m^T 
tbWi&£->< V =! >3?&C Aft L . M-y=j>iliMJ:fC-5-©K 

aic 3 > f ^ - $ -ia«%ib*-r c £ **r # •*>. 

[0 03 7] ^ife^-Cti. BjUgtft^Wft^&i l/T, 

^#>2m$titcm&*mt)Tzv7R>km^tcm&i l ci> io 

[0 03 8] iS^©©**^!!^^ 
3>fc-*-£-©ilf§i7©<^/ctt-C&< A#3fc. m 

«. a i -emm 7 *sA©#©±tc^o rab < <t s tcm-e 

ccoirc. iii»7©«^^X%/hS<-rntf. «t>3^ 

2*>e><i^tfA*3©«$s£f#£fc*&©:3v>K£fc' 20 

/j£-c£>£„ c©#att. site 7 ©As* 3 

*€.^ttii{S7^^sij-r6^fe-c*s. m=.<D*& 30 

[0039] m=<Dmmm*m 1 okst. soafej; 

^SOblJa^fa-^-CDf^^U-/. 8 1 aSU 
8 1btta>ka-i!-m 8 2 aSCX8 2 blit^ 
^-^y^. 8 3 ate.fctfS 3 bttbTx^-*^ 78 2 a* 
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